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Global Convergence of Analytic Neural Networks 
with Event-triggered Synaptic Feedbacks 

Wenlian Lu Member, IEEE, Ren Zheng, Xinlei Yi , Tianping Chen Senior Member, IEEE 


Abstract —In this paper, we investigate convergence of a class 
of analytic neural networks with event-triggered rule. This model 
is general and include Hopfield neural network as a special 
case. The event-trigger rule efficiently reduces the frequency of 
information transmission between synapses of the neurons. The 
synaptic feedback of each neuron keeps a constant value based 
on the outputs of its neighbours at its latest triggering time but 
changes until the next triggering time of this neuron that is 
determined by certain criterion via its neighborhood information. 
It is proved that the analytic neural network is completely stable 
under this event-triggered rule. The main technique of proof is 
the Lojasiewicz inequality to prove the finiteness of trajectory 
length. The realization of this event-triggered rule is verified 
by the exclusion of Zeno behaviors. Numerical examples are 
provided to Illustrate the theoretical results and present the 
optimisation capability of the network dynamics. 

Index Terms —Analytic neural network, complete stability, 
distributed event-triggered rule, Self-triggered rule 


I. Introduction 

rjl HIS paper focuses on the following dynamical system 

( X = —Dx — y f{y) + 0 

{ tA A 

\^y = 9{Ax), 

where x € R" is the state vector, Z? is a constant self-inhibition 
matrix, the cost function f{y) is an analytic function and 9 € 
R" is a constant input vector, y = g{Ax) is the output vector 
with the sigmoid function g{-) as nonlinear activation function. 

Eq. O was firstly proposed in na and is a general 
model of neural-network system arising in recent years. For 
example, the well-known Hopfield neural network m, El, 
whose continuous-time version can be formulated as 

X • 

CiXi — r— uJijUj H- Oi 

Ki j^i ( 2 ) 

Vi — Qi 7 
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for Z = 1, • • • ,n, where Xi stands for the state of neuron i and 
each activation function gi{-) is sigmoid. With the symmetric 
weight condition = ujji for all i,j = 1, • • • , n), Eq. 
can be formulated as Eq. ([B with /(y) = -i 
This model has a great variety of applications. It can be 
used to search for local minima of the quadratic objective 
function of f{y) over the discrete set {0,1}" El-El, for 
example, the traveling-sales problem 0. One step further, 
this model was extended for a multi-linear cost function 

El- This model can be 
also regarded as a special form of (Ell with /(y) = E{y) 
and was proved that this model can minimize E{y) over the 
discrete set {0,1}" El- 

In application for optimisation, analysis of convergence 
dynamics is fundamental, which has attracted many interests 
from different fields. See Q-d and the references therein. 
The linearization technique and the classical LaSalle approach 
for proving stability Q, El could be invalid when the system 
had non-isolated equilibrium points (e.g., a manifold of equi¬ 
libria) Cal- A new concept ’’absolute stability” was proposed 
in a, d, in to show that each trajectory of the neural 
network converges to certain equilibrium for any parameters 
and activation functions satisfying certain conditions by prov¬ 
ing the finiteness of the trajectory length and the celebrated 
Lojasiewicz inequality Qa-ci- This idea can also be seen 
in an earlier paper il- 

However, in the model ID, the synaptic feedback of each 
neuron is continuous bsed on the output states of its neigh¬ 
bours, which is costly in practice for a network of a large 
number of neurons. In recent years, with the development of 
sensing, communications, and computing equipment, event- 
triggered control ini-Ea and self-triggered control EH- 
EOl have been proposed and proved effective in reducing 
the frequency of synaptic information exchange significantly. 
In this paper, we investigate global convergence of analytic 
neural networks with event-triggered synaptic feedbacks. Here, 
we present event-triggered rules to reduce the frequency of 
receiving synaptic feedbacks. At each neuron, the synaptic 
feedback is a constant that is determined by the outputs of its 
neighbours at its latest triggering time and changes at the next 
triggering time of this neuron that is triggered by a criterion 
via its neighborhood information as well. We prove that the 
analytic neural networks are convergent (see Definition E) 
under these event-triggered rules by the Lojasiewicz inequality. 
In addition, we further prove that the event-triggered rule is 
viable, owing to the exclusion of Zeno behaviors. These event- 
triggered rules are distributed (each neuron only needs the 
information of its neighbours and itself), asynchronous, (all 
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the neurons are not required to be triggered in a synchronous 
way), and independent of each other (triggering of an neuron 
will not affect or be affected by triggering of other neurons). 
It should be highlighted that our results can be easily extended 
to a large class of neural networks. For example, the standard 
cellular networks ll34l - ll^ . 

The paper is organized as follows: in Section |II] the prelim¬ 
inaries are given; in Section [Till the convergence and the Zeno 
behaviours of analytic neural networks with the triggering 
rules : distributed event-triggered rule is proved in Section HHl 
in Section|V] examples with numerical simulation are provided 
to show the effectiveness of the theoretical results and illustrate 
its application; the paper is concluded in Section IVTl 
Notions: R" denotes n-dimensional real space. || • || represents 
the Euclidean norm for vectors or the induced 2-norm for 
matrices. Br{xo) = {x € R" : ||a; — xqH < r} stands for an 
n-dimensional ball with center xq G R" and radius r > 0. For 
a function F{x) : R" —R, yF{x) is its gradient. For a set 
Q C R" and a point xq G R", dist {xo,Q) = infygQ ||xo — 1 /|| 
indicates the distance from xq to Q. 


II. Preliminaries and problem formulation 


In this section, we firstly provide some definitions and 
results on algebraic graph theory, which will be used later, 
(see the textbooks ED, iOl for details) 

For a directed graph Q = (12, f, A) of n neurons (or nodes), 
where V = {ui,--- ,u„} is the set of neurons, f C V x V 
is the set of the links (or edges), and A = [ay]„xn with 
nonnegative adjacency elements G {0,1} is the adjacency 
matrix, a link of is denoted by e{i,j) = {vi,Vj) G E \f 
there is a directed link from neuron Vj to Vi and the adjacency 
elements associated with the links of the graph are positive, 
(i.e., e{i,j) G E 'lf and only if > 0). We take an = 0 for all 
i = 1, • • • ,n. Moreover, the in-neighbours and out-neighbours 
set of neuron Vi are defined as iV“ = {vj G V : > 0} and 

= {vj G V : aji > 0}. The neighbours of the neuron 
Vi denoted by Ni is the union of in-neighbours TV” and out- 
neighbours TV°”, that is, Ni = TV” IJ TV°“^ 

Consider the discrete-time synaptic feedback, Eq. ([TJ can 
be reformulated as follows 


Xi{t) = -diXi{t) - 

Viit) = 9i{Kxi{t)) 


V/(y(iI,(*))) 


+ 


for i = I,-- - ,n and ki{t) = 0,1,2, •••, where Xi G R , 
di > 0 and 9i G R. f{y) : R” —>■ R is an analytic cost 
function function and yi = gi{\iXi) is the output vector with 
a scaling parameter > 0 and the sigmoid functions gi{-) as 
nonlinear activation functions. In this paper, we take 


and the gradient of the activation function p(-) at x G R" 
can be written as dg{x) = cT/ag{pj(xi), • • • , 5 (i(x„)}. The 
strict increasing triggering event time sequence (to 

be defined) are neuron-wise and t\ = 0, for all T = 1, • • • , n. 
At each t, each neuron i changes the information from its 
neighbours with respect to an identical time point with 


kiit) = argmaxj,,{fj,, ^ t}. Throughout the paper. We may 
simplify the notation as unless there is a potential 

ambiguity. Thus, we have 


j Xi{t) = -diXi{f) - 


II 



( 3 ) 


for i = I,-- - ,n and k = 0,1,2,-Fet F{x) = 
[F'i(x),--- ,Fn{x)]^ be the vector at the right-hand side of 
©, where 


Fi{x) = -diXi 


V/(2/(4)) 


+ Oi- 


Note that when we consider the trajectories, the right-hand side 
of © can be written as F(x(T)) = [F'i(x(f)), • • • ,Fn{x(t))]^. 
Denote the set of equilibrium points for © as 

5={xGR”:-F(x) = o}. 

We first recall the definition of convergence for model © ll^ . 


Definition 1: m Given an analytic function /(•), a sig¬ 
moid function gi{-) and three constants di, 9i and \i specifi¬ 
cally, system © is said to be convergent^ if and only if, for 
any trajectory x{t) of ©, there exists x* G S such that 

lim x{t) = X*. 

t—>- + oo 

Since the w-limit set of any trajectory x{t) for the system © 
(i.e., the set of points that are approached by x{t) as f —>■ -boo) 
is isolated equilibrium points, the convergence of the system 
© is global. Our main focus lies in proving that the state x{t) 
of the system © under some given rule can converge to these 
equilibrium points. 

The following lemma shows that all solutions for © are 
bounded and there exists at least one equilibrium point. 

Lemma 1: Given a constant matrix D, a constant vector 9 
and two specific functions /(•) and g{-), for any triggering 
event time sequence (* = I,-"’ there exists a 

unique solution for the piece-wise cauchy problem © with 
some initial data x(0) G R". Moreover, the solutions with 
different initial data are bounded for t G [0, -|-c»). 

Proof: Firstly, we prove the existence and uniqueness of 
the solution for the system ©. Denotes tk = 
where k = 0,1, 2, • • •. Given a time sequence (* = 

1, • • • , n) ordered as 0 = Tq < t\ < < ‘ ‘ ‘ < ‘ 

(same items in treat as one), there exists a unique 

solution of © in the interval [to,ti) by using x(To) = a^(0) 
as the initial data (see, existence and uniqueness theorem in 
IIJTI I. For the next interval [ti,t 2 ), x{ti) can be regarded as the 
new initial data, which can derive another unique solution in 
this interval. By induction, we can conclude that there exists a 
piecewise unique solution over the time interval t G [0, -boo), 
which is for the cauchy problem © with the initial data x(0). 

Secondly, since 0 < pi(x) < 1 (x G R), there exists a 
constant TVf > 0 such that 

—diXi(t) — M Gi Fi{x{t)) ^ —diXi{t) + M 

* This definition is frequently referred to as complete stability of the system 
in the neural network literature, see El 
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Thus for any Eq > 0, there exists rp > 0 such that 


Fi{x{t)) < -eo, V x^{t) > ro 

Fi\x(t)) > £ 0 , V x^(t) < -ro 


where i = 1, - ■ ■ , n. Let 

S= {xeR” : ||x|| ^ro} 

If x(0) ^ B, x{t) will drop into the set B in finite time, which 
implies that B is the w-limit set of any trajectory x{t) and it 
is also positively invariant. Thus all the solutions of Q with 
different initial data are eventually confined in B, hence they 
are bounded for t G [0, +oo). ■ 

Consider now the set of equilibrium points S. The following 
lemma is established in Ha, which shows that there exists at 
least one equilibrium point in S. 

Lemma 2: For the of equilibrium points S, the following 
statements hold: 

(1) iS is not empty. 

(2) There exists a constant ?’ > 0 such that 

sf] (r"\B,(0)) =0. 


To depict the event that triggers the next feedback basing 
time point, we introduce the following candidate Lyapunov (or 
energy) function: 


Hx) =f{y)+Y^ 
2=1 



9i ^is)ds 


(4) 


where y = [yi,--- ,i/„] with y, = gi{\xi) {i = I,-- - ,n). 
The function L{x) generalizes the Lyapunov function intro¬ 
duced for ([T]) in 13, and it can also be thought of as the energy 
function for the Hopfield and the cellular neural networks 
model Q, 041 . In this paper, we will prove that the candidate 
Lyapunov function (HI is a strict Lyapunov function lfT2l . as 
stated in the following definition. 

Definition 2: A Lyapunov function L(-) : R" —R is said 
to be strict if L G C^(R"), and the derivative of L along 
trajectories x{t), i.e. L{x[t)), satisfies L{x) ^ 0 and L{x) < 0 
for X ^ S. 

The next lemma provides an inequality, named Lojasiewicz 
inequality ns. It will be used to prove the finiteness of 
length for any trajectory x{t) of the system (|2l, which can 
finally derive the convergence of system (|3|. The definition of 
trajectory length is also listed in Definition [3] 

Lemma 3: Consider an analytic and continuous function 
H{x) : D C R” R. Let 


Bv = |x £ D : VH{x) = o|. 


For any Xs G Sy, there exist two constants r(xs) > 0 and 
0 < v(xs) < 1, such that 


Definition 3: Let x{t) on t G [0, +oo), be some trajectory 
of (O. For any t > 0, the length of the trajectory on [0,f) is 
given by 


llo,t) = / ||i(s)||'^s- 

Jo 

It was pointed out in [HI that finite length implied the con¬ 
vergence of the trajectory, and was also used to discuss the 
global stability of the analytic neural networks in El. 


III. Distributed event-triggered design 


In this section we synthesize distributed triggers that pre¬ 
scribe when neurons should broadcast state information and 
update their control signals. Section IIII-AI presents the evo¬ 
lution of a quadratic function that measures network dis¬ 
agreement to identify a triggering function and discusses the 
problems that arise in its implementation. These observations 
are our starting point in Section ITlI-Bl and Section ITlI-Cl where 
we should overcome these implementation issues. 

To design appropriate triggering time point of 

system dll for z = 1, • • • , n, we define the state measurement 
error vector e{t) = • • • , en{t)]^ where 


eiit) 


V./(y(f)) 


L J 2 

for t G [tl, ffe+i) with j = 1, • • • 


- v/(y( 4 )) 

L J 2 

, n and fc = 0,1, 2, • • •. 


A. Distributed Event-triggered Rule 

To design the triggering function for the updating 

rule, we define a function vector T'(f) = [T'i(f), • • • , 
with 

where 0 


m 


il Fr{x{t)) 



(5) 


for i = 1, • • • , n and fc = 0,1, 2, • • •. 

What we can observe is a neuron’s state xfit) at a par¬ 
ticular time point or a time period (a subset of [0, +cx))) 
from system (|3|. Given a specific analytic function /(•), we 
can directly figure out the right-hand term Fi{x{t)) without 
knowing the theoretical formula of the trajectory x{t) of the 
system (O on [0, -|-oo) in advance. Thus, 5{t) can also be 
calculated straightly. The samplings for xfit) {i = 1^ - ■ ■ ,n) 
with continuous monitoring or discrete-time monitoring would 
determine the efficiency level and the adjustment cost for the 
system’s convergence. The continuous monitoring can ensure 
a high level of efficiency with large costs, while discrete¬ 
time monitoring on xfit) can reduce the cost, but sacrifice 


\H{x) - ^ ||ViT(x)||, 

for X € 


^ The function can be thought of as a normalized function of 

\Fi(x{t))\ by exponential decay function Thus the coefficient 

5{t) with respect to time t in Eq. ^ can be seen as a parameter from this 
normalization process. 
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the efficiency. In Section HVl we will discuss the discrete-time 
monitoring and give a prediction algorithm for the triggering 
time point based on the obtained information of Xi{t) for 
all f = 1 , • • • , n. 

Theorem 1: Set as the time point by the updating rule 
that 

ffc+i = max |r : Ti{ei,t) < 0, V f 

t -I 

that is 


4+1 = max|T : |ei(f)| ^ 7 ^'z(f), V t G [4,t) j, ( 6 ) 

for i = I,-- - ,n and k = Then, system (O is 

convergent. 

The proof of this theorem comprises of the five propositions 
as follow. 

Proposition 1: Under the assumptions in Theorem [T] L{x) 
in (|4]i serves as a strict Lyapunov function for the system Q. 

Proof: The partial derivative of the candidate Lyapunov 
function L(x) along the trajectory x{t) can be written as|l 


= - Xig'[\iXi{f)) 
= - Xig'{XiXi{t)) 


diXi{t) - y f{y{t)) 

d^Xiif) - [v/(y(4)) 


+ Oi 


- + Vf{y{tl)) 

L J 2 L 

= - Xtg'{XtXi{t)) Ft{x{t)) - ei{t) 


(7) 


and the time derivative of L{x{t)) 

dx^{t) 




d 




2=1 


dt 


= - ^Xig'{XiX,(t)) Fi{x{t)) - e,{t) F,[x{t)). 
2=1 

Consider the inequality 


ei{t)F^{x{t)) ^ 


1 


Fi{x{t)) 


The time derivative ■^L(x{t)) = L[x{f)) can be bounded as 


n 


L{x{t)) = - Xig'{XiXi{t)) 


2=1 


F,[x{t)) - ei{t)F,[x{t)) 


1 ^ 

+ >^i9' 




By using the rule (| 6 ]l, it holds 


L{x{t)) 


2=1 


2=1 




2=1 


= - {a- 


Z =1 

2 


i=l 


<0 




( 8 ) 


for all k = 0,1,2,-For any x ^ S, there exits io G 
{1, • • • , n} such that Lip {x) ^ 0. Thus L{x) < 0. Proposition 
[T]is proved. ■ 

With the Lyapunov function L{x) for system Q and the 
event triggering condition (| 6 ]l, the consequent proof follows 
uni with necessary modifications. 

Proposition 2: There exist finite different energy levels 
Lj {j = 1 , 2 , • • • , m), such that each set of equilibrium points 

Sj = ^x € S : L{x) = Lj and j = 1, 2, • • • , m| 
is not empty. 

Proof: Given an analytic function /(•), a sigmoid function 
gif) and three constants di, 6i and Xi specifically, it follows 
that the candidate Lyapunov function L{x) in (|4]i is analytic 
on M”. 

Suppose that there exist infinite different values Lj (j = 
I,-- - ,+c») such that Sj = {x G S ■. L{x) = Lj} is not 
empty. From Lemma |2] it is known that there exists ri > 
0 such that outside 23^ ( 0 ) there are no equilibrium points. 
Hence Sj C (0) for j = 1, • • • , +cxd. 

Consider points x^ G Sj for j = I,-- - ,+oo. Since 
x^ G S, it holds F{x^) = 0 and from Eq. (|7]i, X/L{x^) = 0. 
Since (0) is a compact set, hence, there exist a point 
X and a subsequence such that ^ x for all 

h = I,-- - ,+CX) and a;!'* —^ a? as /i —> +oo. Since VL is 
continuous, taking into account that VL{x^^) ~ 0 for all 
/i = 1, • • • , + 00 , it results VL(x) = 0. 

According to Lemma [3] there exist r{x) > 0 and v{x) G 
(0,1) such that |L(a;) — ^ ||VL(x)|l for x G 

Br{x){x)- Since x^^ —>■ a; as /i —>■ +oo and a;-^'* G Sj^ have dif¬ 
ferent energy levels Lj^, we can pick a point x^’^o g B^^^-^ix) 
such that L{x^^o) ^ L(x). Then 

0< \L{x^>'o) - sC ||VL(a;^''‘o)|| =0, 


which is a contradiction. This completes the proof. ■ 

Without loss of generality, assume that the energy levels 
Lj (j = 1, 2 , • • • , m) are ordered as Li > L 2 >■■■ > Lm- 
Thus there exists 7 > 0 such that Lj > Lj+i + 27 , for any 
j = 1, 2, • • • , m — 1. For any given e > 0, define 

Fj = |x G K” : dist(a;,5j) ^ e|, 

and 

/Cj = Fj Pi {a; G K” : L{x) G [Lj - 7 , L^ -f 7 ] }. (9) 


^ In order to avoid ambiguity, we point out that Ffxtf)) = —dix{t) — Proposition 3. For j 1,2, • • • , m, ICj is a compact set 
[V/(t/(t),.(j)))] . -I- 9i, for i = 1, ■ ■ • ,n. and /Cj p| 5 = Sj. 
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Proof: From Lemma |2] Sj € Br^ (0) is bounded, hence 
Fj is a compact set and {x G K" : L{x) G [Lj — 7 , Lj + 7 ]} 
is a closed set. Thus, JCj = Fj P| {a; G K” : L{x) G [Lj — 
'y,Lj + 7 ]} is a compact set. Then proterty /Cj P|5 = Sj is 
an immediate consequence of Proposition |2l ■ 

Proposition 4: For any trajectory x{t) of the system Q 
and any given time point r ^ 0, let /Cj, for some j G 
{1, 2, • • • , m}, be a compact set as defined in (|9|l. Then there 
exist a constant Cj > 0 and an exponent Vj G (0,1) such that 


L{x{t)) 


F{x{t)) 




L{x{t)) - Lj 


for x{t) G /Cj \ S. 

Proof: Since the notion is simplified as t\. where 

ki{T) = argmaxfc/{/^, ^ r}, the following equation 


v/(y(4M)) 


Fi{x{T)) = - 

can be rewritten as 

^*(a:(r)) = -d^Xi{tl) - [v/(y(4)) 


+ Si, 


+ di, 


for i = 1, - ■ ■ ,n. From Eq. (|7]i and the condition (| 6 ]l, we have 


VL(a;(T)) 


=E 

2=1 

n 

=E 

2=1 




2=1 

n 

2=1 


Kg'{Kxi{T)) F^{x{t)) - ei{T) 

Ff{x{T)) +el{x{T)) +2 Fi{x{T))ei{x{T)) 
(1 + {x{t)) + (^1 + el (x(t)) 


g: 


/3|(1 + c) x: \FMr)) f + /3| (1 + 1 ) 1 ^ E 

2=1 ^ ^ 2=1 


= /3?(l + c) 


2=1 2=1 




/ 2\ ^ 


2=1 

2 


= /3|(l + c)(l + —] F{xiT)) 


F{x{t)) 


^ hn 


\7L{x{t)) 


where 


From Eq. ([ 8 ]l, we have 

L{x{t)) ^(a-/37^) F{x(t)) 

Eor the point x{t) G ICj \S, from Eq. (I7]i, SIL{x{t)) f 
0. There exists r(x(T)) > 0, c(a:(r)) > 0 and an exponent 
v(x(t)) G (0,1) such that 

VL(x(t)) ^ c(x(r)) L(x(r)) - Lj ^ ^ 

for X G Br(x(T)){x{T)). Indeed, if r{x{T)) > 0 is small, we 
have WL{x) f 0 for x G Bj.(x(t)){x{t)). Therefore, it holds 


L{x{t)) 


F{x{t)) 


>(q;-/37^) F{x{t)) 

[a — I3"t^)hj VL{x{t)) 

> {a- f3j‘^)hjc{x{T)) L[x{t)) -L 


v{x{t)) 


^ Co 


L{x{t)) - Lj 


where 


and 


Cj = (a- ^7^) hj niin { c(x(t)) | 

x(T)G/Cj ^ J 

{v(x(T))j 


where /3j = maxig{i_... _„} maXx(r)eK:j{Kgi(Kxi(T))}. Then 
it holds 


hj — 


1 

L{x{t)) 


-L{x{t)) 


(1 + c)(l + 

F{x{t)) 


F{x(t)) 



Vj = mm 

x(T)e/Cj 

for x{t) G ICi\S. ■ 

Now, we are at the stage to prove that the length of x{t) on 
[0, + 00 ) is finite. The statement proposition is given as follow. 

Proposition 5: Any trajectory x{t) of the systm (|3ll has a 
finite length on [ 0 , + 00 ), i.e., 

r+co pt 

^[0+00) = / p('S) ds = lim / i:(s) ds <+00. 

7o *^+°° Jo 

Proof: Assume without loss of generality that x(0) is 
not an equilibrium point of Eq. Q. Due to the uniqueness 
of solutions, we have x{f) = F{x{t)) f 0 for f ^ 0, i.e., 
x{t) G M" \ S for f ^ 0. Erom Proposition [T] it is seen 
that L{x(t)) satisfies L{x{t)) < 0 for t ^ 0, i.e., L{x(t)) 
strictly decreases for f ^ 0. Thus, since x{t) is bounded on 
[0,+ 00 ) and L{x{t)) is continuous, L{x{t)) will tend to a 
finite value L(+oo) = limt_>_|_oo L{x{t)). Prom Proposition [T] 
and the LaSalle invariance principle lf3^ . llJTll . it also follows 
that x{f) S it ^ + 00 ). Thus, from the continuity of L, it 
results L(+oo) = Lj for some j G {1, 2, • • • , m} and x{t) —>■ 
Sj it —y -t- 00 ). 

Since x[t) —>• Sj {t + 00 ) and L{x{t)) —>■ Lj {t —>■ + 00 ), 
it follows that there exists f > 0 such that x{t) G ICi for f ^ L 
By using Proposition 0] considering that x{t) G K" \ S for 
t ^ 0 and x{t) G ICi for t ^ t, we have that there exists 
Cj > 0 and Vj G (0,1) such that 


L[x{t)) — L(+oo) 
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for t t. Then 

pt 


\\x{s)\\ds = F(x(s)) 


€ 


ds 

-L{x{s)) 


Jt 


L{x{s)) — L(+oo) 


-ds. 


The change of variable a = L{x{s)) derives 

rt 2 ^ rL{x{t)) ^ 

\ds < — / 




-da 


JL{x{t)) 


\a — L(+cxd)I ■" 
L(x{t)^ — L{-\-oo) 


€ 


L(^x{t)) — L(+oo) 
1 


1 — 1?7 




for t ^ t. Therefore, we have 

^+oo 

^[ 0 ,+oo) = / 

Jo 


L{x{t)^ — L(+oo) 


-| 1—V-i 


i:(s) ds 


pt p + oo 

^ / ||i:(s)||ds+ / ||i(s) 


ds 


^ / ||i:(s)||ds + 
Jo 

< +0O. 


L{^x{t)') — L(+oo) 


1—V-i 




It seems naturally that when the event triggers, the neuron 
Vi has to send its current state information Xi{t) to its out- 
neighbours immediately in order to avoid having ■^L{x{t)) > 
0. However, such a trigger would have the following problems: 

(PI) The triggering function Ti{ei,t) = 0 may hold even 
after neuron Vi sends its new state to its neighbours. A 
bad situation is that 'l'(f) = 0 happens at the same time 
when |ei(f)| = 0. This may cause the neuron to send its 
state continuously. This is called continuous triggering 
situation in the Zeno behavior 0 . 

(P2) Event if T'(f) = 0 and \ei(t)\ = 0 never happen at 
the same time point. The Zeno behavior may still exist. 
For example, one neuron Vi broadcasting its new state 
to its out-neighbours may cause the triggering rules for 
two neurons Vj^ and Vj^ in iV°“‘ are broken alternately. 
That is to say, the inter-event time for both Vj^ and Vj^ 
will decrease to zero. This is called alternate triggering 
situation in the Zeno behavior. 

These observations motivate us to introduce the Morse-Sard 
Theorem for avoiding the continuous triggering situation (f[Tli 
in Subsection IIII-BI In Subsection IIII-CI we will also prove 
that for all the neuron Vi {i = I,-- - ,n), the alternate 
triggering situation is absent by using our distributed event- 
triggered rule in Theorem [T] 


B. Exclusion of Continuous Triggering Situation 

From the rule (|6l), we know that a triggering event happens 
at a threshold time satisfying 


This completes the proof of Proposition |5] ■ 

In what follows it remains to address the proof of Theorem 
[U which is given in Section UlI-AI 

Proof of Theorem |7} Suppose that the condition (|6]l holds. 
Then from Proposition |5] for any trajectory x{f) of the system 
we have 

p + OO pt 

ho-t-oo) = / ll^(■s)||ds= lim / ||i(s)II ds <-boo. 

Jo 

From Cauchy criterion on limit existence, for any £ > 0, 
there exists T^e) such that when t 2 > ti > T(e), it results 
||i(s)||ds < £. Thus, 


x{ti) - x{t 2 ) 



i(s) ds 


pt2 

< / 11^(5)11 ds < e. 

Jti 


It follows that there exists an equilibrium point x* of ©, such 
that limt_j.+oo a:(f) = x*. Recalling the Definition [T] we can 
obtain that system © is convergence. ■ 

Remark 1: The event-triggered condition © implies that 
the next time interval for neuron Vi depends on states of the 
neurons Vj that are synaptically linked to neuron Vi We say 
that neuron Vj is synaptically linked to neuron Vi if [V/(t/)]i 
depends on yj, in other words. 


dyzdyj ^ 


TiAifl) = |e*(ffc)| =0 


for i = 1, • • • , n and fc = 0,1, 2, • • •. 

To avoid the situation that = 0 and \ei{t)\ = 0 happen 
at the same triggering time point t\. for some k, when the 
triggering function Ti{ei,t) = 0 still holds after the neuron 
Vi sends the new state to its neighbours, we define a function 
vector 


S{ftr) 




where 


n 

^ U ^ ^ ™d fc = 0,1,2, • • • I (10) 

i=l 


is one of the triggering time points before the present time 
t and SA^tr) = fr), • • • , Snitfr)]^■ The following 

Morse-Sard theorem will be used for excluding this continuous 
triggering. 

Theorem 2 (Morse-Sard): For each initial data a;(0), there 
exists a measure zero subset O C M" such that for any 
given neuron Vi (i = I,-- - ,n), the threshold time tr for 
fr) = 0 corresponding to initial data a;(0) € R"\C> 


^ Zeno behavior is described as a system making an infinite number of 
jumps (i.e. triggering events in this paper) in a finite amount of time (i.e. a 
finite time interval in this paper), see (38). 
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are countable for all k = 0,1,2, •••. That is to say, the 
triggering time point set 


n +00 

U U { 4 } 


i—l fe =0 


is a countable set. 

Proof: To show that the threshold time tr are countable 
for each x(0) S we prove a statement that the Jacobian 

matrix d5'(f,fr) = [d5'i(f, ‘ f^)] has rank n 

at next triggering time point t = where 




d ^ r \ d ^ , 


which implies 


dSi ( 4 + 1 , tr) = lim dS'i (4+i + e, U) 


= lim 
£— ^0 




t—tl,. +£ 


7 4^'i(4+i)>-7 4^a4+i) 


40 


thus, for each initial data x(0) £ ]R”\C> with 


^ = U U = 0 ’ 

fe=l i—l 


( 11 ) 


The two components of the above equation satisfy 

9 ^ / \ / xdedf) 2 t / \d'I'i(f) 

-g^S,{t,tr) = - 7 




= d^L 




and 


the Jacobian matrix dS{t,tr) has rank n at time t = 4-+i- 
Now using the inverse function theorem at each a;(0) £ 
M"\0, we can obtain that for each threshold time defined 
in Eq. ( fTOl i. the next triggering time point 4+1 is isolated, 
hence the set 


n +00 

U U { 4 } 


;=i fc=o 


A 

dtr 


Si{t,tT) 


^.^dei(^) 2 ,t, 

edO-jT-7 diiit)- 


dtr 


dtr 


dir L di 


When event triggers and ei{t) resets to 0 in the short time 
period after the next time point 4+i’ ’^hat is, ei(4+i +e) —5“ 0 
when e —0, then it follows 


d 


lim —Si(t,tr) 

e^O dt ^ ' 


and 


lim -7^S^{t,tr) 

e ->0 dt-T 


= 7 d*^'a4+i) 




= -7^4T'a4+i). 


*—*fc+i+® 


Define a initial data set for neuron Vi by 


is a countable set. The Morse-Sard theorem is proved. 

■ 

Recalling the triggering function Ti{ei,t), we can obtain 
the results that if the initial data a;(0) £ IR"\C>, then 

n +00 

d/iu) 4 0 for all a £ IJ U {4} 

i=l k=0 

that is to say, d>i{t) = 0 and |ei(f)| = 0 may never happen 
at the same time at all the triggering time point 4 where 
i = 1, • • • , n and k = 0,1,2,---. Therefore, the continuous 
triggering situation in the Zeno behavior (F[T]i is avoided. 

Remark 2: To refrain a;(0) from the zero measured subset 
O, a small perturbation on initial data x(0) can be introduced, 
which can make it be away from the value that leads to x(0) £ 
O. The small perturbation on initial data has no influence on 
the convergence of the system, for the equilibria of the system 
(|3ll do not depend on the initial data sensitively. 


0\ = |a; 40 ) £ K : (5^. = 0, for all j = 1, • • • , n| 


C. Exclusion of Alternate Triggering Situation 


and it holds m{0]f) = 0 in the sense of Lebesgue measure. 
Take the initial data a;i(0) from K.\C>^, we have 


s{tUi) 


i=i 


/E- 

7=1 


3 4) 


40 


that is, 

«'*(4+i) = ')(4+i) e-'^dd+i-d) ^ 0 


After we exclude the continuous triggering situation in 
the above section, what remains is the alternate triggering 
situation in the Zeno behavior. To prove that this situation is 
absent when using the distributed event-triggered rule (|6]l, we 
will find a common positive lower-bound for all the inter-event 
time 4+1 ~ 4” where * = 1, • • • , n and fc = 0,1, 2, • • •. 

Theorem 3: Let CJ be a zero measured set as defined in (fTTl i. 
Under the distributed event-triggered rule (|6]l in Theorem [T] 
for each a;(0) £ ]R"\(!J, the next inter-event interval of every 
neuron is strictly positive and has a common positive lower- 
bound. Furthermore, the alternate triggering situation in the 
Zeno behavior is excluded. 




























Proof: Let us consider the following derivative of the state 
measurement error for neuron Vi (i = 1 , • • • , n) 


M = 


n 

W^f{y{t))] yj{t) 

n 


i=i 


€ 


VV( 2 /(i)) Adg{Ax{t)) 


\ 3 = 1 


^'^f{y{'t)) Adg{Ax{t)) 5{f)^ 
^ ||A||-v/ni5(t), 


\ 3 = 1 


where 


A 1 = max 

tG[0,+oo) 


VV( 2 /(t)) 


then it follows 


J ei{s)ds ^ J |ei(s)|ds ^ (5(f)Al 


A\\Vn{t - tl). 


Based on the distributed event-triggered rule (| 6 ]l, the event will 
not trigger until |ei(f)| = 7 'I'i(f) at time point t = > t\. 

Thus, for each a:(0) G R"\C>, it holds 


7 5(f) e = |ei(f)| ^ 5(f)7W||A||\/7I(4+i- 4 ) 


namely, 


^g-diVi 

M\\A\\y/^ 


with gi = — t\, which possesses a positive solution. 

Hence, for all the neuron Vi {i = I,-- - ,n), the next inter¬ 
event time has a common positive lower-bound which follows 


It can be seen that g has no concern with all the neurons’ 
states Xi{t) {i = I,-- - ,n). Thus, there exists a common 
positive lower-bound, which is a constant, for the next inter¬ 
event interval of each neuron. That is to say, the next triggering 
time point satisfies ^ for alH = 1 , • • • ,n and 
= 0 ,1, 2 , • • •, hence the absence of the alternate triggering 
situation in the Zeno behavior (fO is proved. ■ 

To sum up, we have excluded both the continuous trigger¬ 
ing situation and alternate triggering situation in the Zeno 
behavior, when the distributed event-triggered rule is taken 
into account. Therefore, we can assert that there is no Zeno 
behavior for all the neurons. 


IV. Discrete-time monitoring 

The continuous monitoring strategy for Theorem [T] may be 
costly since the state of the system should be observed simul¬ 
taneously. An alternative method is to predict the triggering 


time point when inequality (| 6 ]) does not hold and update the 
triggering time accordingly. 

For any neuron Vi (z = 1, • • • ,n), according to the current 
event timing its state can be formulated as 


Xi{t) = Xiitl) + — <{ diX^{tl) + 


v/(y(fD) 


-e, 




(13) 


yi{t) = 9i{\xi{t)) 


for < t < where is the newest timing of all vfs 

in-neighbours, that is 

tt = max \ti} 

3eW 

and is the next triggering time point at which neuron 
Vi happens the triggering event. Then, solving the following 
maximization problem 

A4 = max |f - : |ej(f)| < 7 T'i(t)}, (14) 

we have the following prediction algorithm (Algorithm [T]) for 
the next triggering time point. 

With the information of each neuron at time and the 
proper parameters 7 , search the observation time by (fT4l) 
at first. If no triggering events occur in all vfs in-neighbours 
during + At].), the neuron Vi triggers at time -f 

Af^ and record as the next triggering event time that is 
ffe+i = ffc + At].. Renew the neuron vfs state and send the 
renewed information to all its out-neighbours. The prediction 
of neuron Vi is finished. If some in-neighbours of Vi triggers 
at time t G (ffej ffe + update in state formula (fOl l and 
go back to find a new observation time -b At], by solving 
the maximization problem (fT4l). 


Algorithm 1 Prediction for the next triggering time point 
// N™ is the set of neuron vfs in-neighbours 
Require: 

1 : Initialize 7 > 0 

2: f* ^ maxjg^in tl 

3: Xi{f) ^ Xi(t]) for all z = 1, • • • , rz 

Ensure: 

4: Flag ^ 0 
5: while Flag = 0 do 
6: Search At] by the strategy (fT4l i 

7: T i — t] -f At] 

8 : if No in-neighbours of Vi trigger during [t], r) then 

9: Vi triggers at time = r 

10 : Vi renew its state information Xi{t]_^.^^) 

11 : Vi sends the state information to its out-neighbours 

12 : Flag ^ 1 

13: else 

14: Update t] in the state formula (fOl) 

15: end if 

16 : end while 

17: return t]_^_^ 
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In addition, when neuron Vi updates its observation time 
At]., the triggering time predictions of u^’s out-neighbours 
will be affected. Therefore, besides the state formula ( fTSl l and 
the maximization problem (fT4l i as given before, each neuron 
should take their triggering event time whenever any of its 
in-neighbours renews and broadcasts its state information. In 
other word, if one neuron updates its triggering event time, it 
is mandatory to inform all its out-neighbours. 

Remark 3: The discrete-time monitoring by using the state 
formula (fTSl l may lose the high-level efficiency of the conver¬ 
gence, because it abandons the continuous adjustment on 5{t) 
as defined in Eq. (|5ll. But the advantage is that a discrete-time 
inspection on x{t) can be introduced to ensure the convergence 
in Theorem [T] This can reduce the monitoring cost. 

V. Examples 

In this section, two numerical examples are given to 
demonstrate the effectiveness of the presented results and the 
application. 

Example 1: Considering a 2-dimension analytic neural net¬ 
work with 

/(y) = -\y^Wy, 

where 

D = A = l2, 9 = 

We have 

V/(y) = -Wy 

and adopt the distributed event-triggered rule (Theorem [T]). 
The initial value of each neuron is randomly selected in the 
interval [— 1 , 1 ]. Eigure [T] shows that the state x{t) converges 
to ly = [2.7072,-1.6021]^ with the initial value a;(0) = 
[—0.6703, 0.6304]^ by taking 7 = 0.5. 


rate. All results are drawn by averaging over 50 overlaps. It 
can be seen that the actual calculation minimal inter-event time 
Afmin is larger than the corresponding theoretical lower-bound 
rj. This implies that we have excluded the Zeno behavior with 
the lower-bound rj of the inter-event time for all the neurons. 
Moreover, The actual number of event N decrease while Ti 
increases with 7 increasing, which is in agreement with the 
theoretical results. 


TABLE I 

Simulation results with different 7 under the distributed 

EVENT- TRIGGERED RULE 


7 

V 

Afmin 

N 

Ti 

0.1 

0.4676 

0.6072 

42.10 

31.6612 

0.2 

0.4914 

0.8920 

26.90 

32.5330 

0.3 

0.5378 

1.0560 

21.16 

32.8354 

0.4 

0.5974 

1.1643 

17.92 

33.0597 

0.5 

0.6514 

1.2014 

15.58 

33.0533 

0.6 

0.7224 

1.2020 

14.48 

33.2765 

0.7 

0.7826 

1.2018 

12.70 

33.4677 

0.8 

0.8232 

1.2028 

13.22 

33.4744 

0.9 

0.8446 

1.2043 

12.76 

33.4854 


According to the definition of Lyapunov (or energy) func¬ 
tion ©, if the input || 0 || takes a sufficient small value and 
Xi —>■ -boo for i = 1,2, then L{x) ~ f{y)- Thus, as an 
application of our results, system Q with the distributed 
event-triggered rule can be utilised to seek the local minimum 
point of f{y) over {0,1}^. Denote 

y(A) = lim g{Ax{t)), 

i—>-+oo 

where x(t) is the trajectory of the system Q. Thus y{A) is 
the local minimum point of H(y) as 




Fig. 1. The state x(t) of two neurons converges to u = [2.7072, —1.6021]^ 
with 3;(0) = [-0.6703, 0.6304]T. 


Hiy) = -^y^Wy, 

Figure [ 2 ] shows that the terminal limit y(A) converge to a local 
minimum points [1,1]^ as Xi —>■ -\-oc for i = 1, 2 . 


1 - 

0 . 8 - 

0 . 6 - 

0.4- 


Take the different values of the parameter 7 under the 
distributed event-triggered rule, the simulation results are 
shown in TableU In this table, rj is the theoretical lower-bound 
for the inter-event time of all the neurons calculated by (fT2l) . 
^fmin = minig{i_... _„} minfeg{o,i, 2 , - }(ffc+i-ffe) is the actual 
calculation value of the minimal length of inter-event time. N 
is number of triggering times and Ti stands for the first time 
when ||x(i) — u\\ < 0 . 0001 , as an index for the convergence 


0 . 2 - 

0 - 

0 0.2 0.4 0.6 0.8 1 

h 

Fig. 2. The limit y{A) converges to a local minimum point [1,1]^. We 
select 9 = [0.001, 0.001]^, 7 = 0.5, and random initial data in the interval 
[— 1 , 1 ]. Ai = A 2 are selected from 0.01 to 100 . 
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Example 2: Consider a 2-dimension neural network ([3]) with 

fiy) = (jyi ~~ \y^^y + y 

where 

D = A = l2, 6 = 


vf{y) = 3j2{y!-y^)-wy + i 

i=l 

and take the distributed event-triggered rule (Theorem[TJ- The 
initial value of each neuron is randomly selected in the interval 
[—5,5]. Figure 0 shows that the state x{t) converges to = 
[0.6911, —1.3089]^ with taking 7 = 0.5. 


,W = 


2 2 
2 2 



Fig. 3. The state x(t) of two neurons converges to = [0.6911, —1.3089]^ 
with 3;(0) = [-2.922, -3.557]^. 


We also calculate the index rj, Afmin, N and Ti with 
different values of 7, as shown in Table |II| by averaging over 
50 overlaps. The notions are the same as those in Table U 

TABLE II 

Simulation results with different 7 under the distributed 

EVENT- TRIGGERED RULE 


7 

V 

^^min 

N 

Ti 

0.1 

0.1540 

0.2892 

20.38 

21.7786 

0.2 

0.1639 

0.3052 

19.47 

21.1697 

0.3 

0.1716 

0.3308 

18.52 

20.8751 

0.4 

0.1854 

0.3654 

17.95 

20.4182 

0.5 

0.1983 

0.3939 

18.09 

20.2560 

0.6 

0.2014 

0.4213 

17.26 

19.9064 

0.7 

0.2154 

0.4582 

16.67 

19.5929 

0.8 

0.2279 

0.5106 

16.25 

19.3727 

0.9 

0.2348 

0.5352 

16.04 

18.6549 


It can also be seen from the Table HIl that we have excluded 
the Zeno behavior with the theoretical lower-bound rj of 
the inter-event time smaller than the actual calculation value 
Afrnin Under the distributed event-triggered rule. In addition, 
the actual number of events N decreases while Ti increases 
with the increasing 7. 

Similar to the first example, if ||0|| is sufficiently small and 
let Xi — >• -(-00 for i = 1,2, it follows L{x) ~ f{y)- As 


an application, we use the distributed event-triggered rule to 
minimize 

H{y) = (^yf - yf] - ^y^Wy + y 

over {0,1}^. Denote 

|/(A) = lim g{Ax{t)), 

where x{t) is the trajectory of ([3]l. Then y{A) is the local 
minimum point of H{y) when ||0|| is sufficiently small and 
Xi -(- 00 . Figure |4| shows that the terminal limit y{A) 
converges to two local minimum points [1,0]^ and [0,1]^ 
as Xi —>• -(-00 for i = 1,2. 

1 - <> 

0 . 8 - • 



0 - • 

0 0.2 0.4 0.6 0.8 1 

Vi 


Fig. 4. The limit ^(A) converges to two local minimum points [1, 0[^ and 
[0,1[^. We select 6 = [0.001, 0.001[^, 7 = 0.5, and random initial data in 
the interval [—5,5[. Ai = X 2 are picked from 0.01 to 100. 


VI. Conclusion 

In this paper, two triggering rules for discrete-time synaptic 
feedbacks in a class of analytic neural network have been 
proposed and proved to guarantee neural networks to be 
completely stable. In addition, the Zeno behaviors can be ex¬ 
cluded. By these distributed and asynchronous event-triggering 
rules, the synaptic information exchanging frequency between 
neurons are significantly reduced. The main technique of 
proving complete stability is finite-length of trajectory and 
the Lojasiewicz inequality na. Two numerical examples have 
been provided to demonstrate the effectiveness of the theoret¬ 
ical results. It has also been shown by these examples the 
application in combinator optimisation, following the routine 
in 0. Moreever, the proposed approaches can reduce the cost 
of synaptic interactions between neurons significantly. One 
step further, our future work will include the self-triggered 
formulation and event-triggered stability of other more general 
systems as well as their application in dynamic optimisation. 
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